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Abstract 

We propose an ultrametric breaking of replica symmetry for di- 
luted spin glasses in the framework of Random Multi-Overlap Struc- 
tures (RaMOSt). Our approach permits to bound the free energy 
through a trial function that depends on a set of numbers over which 
one has to take the infimum. Such trial function is a first (ultrametric 
and factorized) example of a bound in the intersection of the proba- 
bility spaces of the iterative and the RaMOSt theories, and it shows 
that a "direct dilution" of the Parisi Ansatz is not always exact. 

Key words and phrases: diluted spin glasses, replica symmetry breaking, 
ultrametric overlap structures. 

1 Introdution 

In the case of non-diluted spin glasses, M. Aizenman R. Sims and S. L. 
StarrGl introduced the idea of Random Overlap Structure (ROSt) to ex- 
press in a very elegant manner the free energy of the model as an infimum 
over a rich probability space, to exhibit an optimal structure (the so-called 
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Boltzmann one) , to write down a general trial function through which one 
can formulate various ansatz's for the free energy of the model. It was 
also described how to formulate in particular the Parisi ansatz within this 
formalism. 

In the context of diluted spin glasses, M. Mezard and G. Parisil^ showed 
how to implement the Replica Symmetry Breaking theory by translating it 
into the iterative approach. The result is that the Broken Replica Symme- 
try trial function depends on a nested chain (of Parisi type) of probabilty 
distributions and the order parameter is always a function. The rigorous 
proof that the Replica Symmetry Breaking in the sense of ref. yields 
bounds for the free energy has been given by S. Franz and M. Leone^^, 
and D. Panchenko and M. Talagrand^^. 

In ref. |2| we extended the concept of ROSt to the one of Random 
Multi-Overlap Structure (RaMOSt), to deal with diluted spin glasses. Like 
in the non-diluted case, we could express the free energy of the model by 
means of the Extended Variational Principle, exhibit the optimal Boltz- 
mann RaMOSt, write down the generic trial function, find a factorization 
property of the optimal structures. Here we extend in a natural way the 
Parisi ROSt to an ultrametric RaMOSt. This is interesting to do to check 
whether a "minimal dilution" of the Parisi theory can be valid. It turns out 
that such a minimal dilution leads to a trial function that is properly fac- 
torized and exact in some regions, not exact in some others (while in some 
of these regions the iterative method yields exact results). This means that 
dilute models are deeply different from their infinite connectivity limit, but 
it is not clear how. 

The physics implied by the RaMOSt theory is different (simpler) from 
the one implied by the iterative method, as it is determined explicitly and 
entirely by the multi-overlaps and the trial functions depend only on a set 
of numbers (fixed trial multi-overlaps) and not functions (like the distribu- 
tion of the primary fields of the iterative approach). The ultrametric trial 
function we suggest, is the restriction of the bound proved in refs. |21[7j to 
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the simpler framework of RaMOSt, but our approach has nothmg to share 
with the iterative method. Nonetheless, our approach allows us to recover 
the formulas and bounds from the iterative approach in a different and very 
simple way, provided one leaves certain random variables to be generic in- 
stead of making the restriction that we will use to impose ultrametricity in 
a multi-overlap structure (this connection between the two methods will be 
clearer later on). One way to look at the two approaches is the following. 
One has to introduce some variables to infimize over on which the trial free 
energy depends on. The iterative method considers the cavity fields generic 
random variables and let their distribution vary. The RaMOSt theory let 
the chosen trial multi-overlaps and their (probability) weights vary. In the 
iterative approach the weights are of a given form that cannot change. In 
the RaMOSt approach the cavity fields obey a certain constraint. We will 
point out some advantages of the RaMOSt theory, some weak points, some 
open problems. 

We start our treatment by illustrating the Replica Symmetric bound 
(in section 0J, in a very simple way, close to the strategy typically used for 
non-diluted systems. In this simpler setting we can easily introduce all the 
ideas we need in the general scheme that we report in detail in sectional 
The physical ideas at the basis of our bound are suggested by a particular 
interpretation of the Parisi theory for the (non-dilute) SK model which we 
describe in the last Appendices. 

2 Model, Notations, Definitions 

Notations: 

a, (3 are non- negative real numbers (degree of connectivity and inverse tem- 
perature respectively); 
Pq is a Poisson random variable of mean ^; 

{iu},{ju} are independent identically distributed random variables, uni- 
formly distributed over points {1, . . . , A^}; 
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{Ji,},J are independent identically distributed random variables, with sym- 
metric distribution; 

{ Jjy} are independent identically distributed random variables, with sym- 
metric distribution (different from that of J); 
J' is the set of all the quenched random variables above; 
a : i ^ (7i is a spin configuration; 
7r^(-) is the Poisson measure of mean 

E is an average over all (or some of) the quenched variables; 

u)j is the Bolztmann-Gibbs average explicitly written below; 

fiAT is a product of the needed number of independent identical copies 

(replicas) of wj; 

{■) will indicate the composition of an E-type average over some quenched 
variables and some sort of Boltzmann-Gibbs average over the spin vari- 
ables, that will be clear from the context. 

We will often drop the dependance on some variables or indices or slightly 

change notations to lighten the expressions, when there is no ambiguity. 
We will consider only the case of zero external field, and hence the Hamil- 
tonian of the system of N sites is, by definition 

Hjj^{a, a; J") = - ^ Jy'^i^'^]^ 
i/=i 

We follow the usual basic definitions and notations of thermodynamics for 
the partition function and the free energy per site 

-pfN{P,a) = j^mnZN{l3,a;J) 
and / = limjv /n- 

The Boltzmann-Gibbs average of an observable O is 

u,j{0) = Zn{0, a; jy' ^ 0{a) eM'^H^i^, «; J)) 
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The multi-overlaps are defined (using replicas) by 

1 (1) (n) 

Definition 1 A Random Multi-Overlap Structure 7?^ is a triple (S, {q2n}, £,) 
where 

• E is a discrete space; 

• ^ : S — > is a system of random weights; 

• q2n '■ S^" — > [0, l],n G N, \q\ < 1 is a positive definite Multi-Overlap 
Kernel (equal to 1 only on the diagonal of E^"). 

Notice that the RaMOSt just defined is the minimal extension of the con- 
cept of ROSt to a case where all even multi-overlaps must be considered. 
This is quite the case when dealing with diluted spin glasses, as a con- 
sequence of the fact that here the distribution of the coupling is generic 
and hence determined by all its moments, while in the non-diluted case 
the couplings are centered Gaussians and thus determined by the second 
moment only. That is why all the calculations that in the SK case end 
up in a single term with the 2-overlaps are replaced here by series with all 
(even) multi-overlaps. So the SK case can be seen as the one where the 
series stops at the first term (equivalently, as the infinite connectivity limit) 
and hence we have a recipe to translate from infinite to finite connectivity 
and vice versa (diluting) , modulo a proper temperature rescaling. 



3 Previous results 

Notice thatEl, with Hj^^ = H 

±^ElnJ2^,eM-m - J2 ^]Etanh^"(/3J)(l - (g|„)) . (1) 

7 n>0 
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Consider two random variables -ff. (7i J) ^-^id i?(7, a; J) such that 



d 



Eln^e7exp(-/3#.) = 2 ^ -^Etanh2"(/3J)(1 - (g2„)) (2) 



7 n>0 

;^^^l^E^7exp(-/3^) - 5];^Etanh2"(/3J)(l-(g1„» (3) 



n>0 

d 1 

7 n>0 

and the trial function 

where 7?^ are independent copies of H,. Then in ref. P] we proved the 
following 

Theorem 1 (Generalized Bound) 

-/3/ < lim inf GAr(7^) ; 

N^oc IZ 

Theorem 2 (Extended Variational Principle) 

~f3f = lim inf GA^(7^) ; 

Theorem 3 (Factorization of optimal RaMOSt's) In the whole re- 
gion where the parameters are uniquely defined, the following Cesaro limit 
is linear in N and a 



ClimElnr2A/{^exp[-/3(iJ(a) +iJ(a/7V))]} = N{-Pf + aA)+aA , 
where 

oo JV 

^ = E ^Etanh2"(/3J)(l - (q^J) : ^ = E ^^"^ 

71—1 i—1 

We will see in the next sections what are the conditions on H and H in 
order to obey ©-© when they have a form similar to the Viana-Bray 
Hamiltonian. Concretely, it is like in the non-diluted case, where the two 
variables are always the same, just realized in different spaces. In other 



6 



words, what really changes is S, and H and H assume different represen- 
tations accordingly. 

We want now to construct a trial function with some features. We 
want it to satisfy the invariance property of the optimal structures, we 
want it to be some dilution of the Parisi trial function for the SK model 
and to implement ultrametric breaking of replica symmetry, we want it 
to depend on the distribution of the original couplings only, as physically 
we do not expect other probability distributions to play any role, we want 
it to connect the iterative method with the RaMOSt theory, by being a 
restriction of the general trial function of the iterative approach. 



In this section we find the Replica Symmetric trial function within the 
RaMOSt approach, with no external field. 

The choice of the probability space of the Replica Symmetric RaMOSt 
is trivial, as we do not really need it, just like in the non-diluted case. Still, 
it will serve as a guide to the next section. 

Here is the interpolating Hamiltonian 



where J and J. are symmetric random variables which might have different 
distribution (and different from the one of J ). The partition function Z(t) 
associated to this Hamiltonian is defined in the usual way and the usual 
derivative yields the following standard calculation (see e.g. 0) 



E In Zjv (t) = aE In cosh(/3 J) - 2aE In cosh(/3 J) -I- aE In cosh(/3 J) 



4 The Replica Symmetric RaMOSt 




—a 



V —(tanh^" (;3J)q2 _ 2g2„tanh2"(/3J) 
^ — ' Zn 

n>0 

+ tanh2"(/3J))t . 
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where the term in J is clearly vanishing (if J is symmetric) but we put it 
there because we wanted to add and subtract a certain quantity written in 
two different ways trying to "compose a square" . Expressing the exponen- 
tial of the part in J in terms of hyperbolic cosine and tangent (as opposed 
to just cancel it trivially with the logarithm) complicates things but yields 
the right expressions for the quantity to be added and subtracted. The con- 
tribution at t = to the t-dependent free energy is computed in Appendix 
1X1 From the expression above it is clear that the order parameter has to be 
determined by tanh^"(/3J)/ tanh^"(/3J). It is therefore convenient to give 
such fractions a name by defining the so-called primary field g so that 

tanh(/3 J) = tanh(/3J) ianh{(3g) . 

One can readily check that using this definition the next steps lead to the 
usual Replica Symmetric trial function which also gives the correct critical 
point if expanded in power series (at the fourth order). We want instead 
to perform a specific choice in order to include the Replica Symmetric trial 
function within the framework of RaMOSt's. Namely let us choose J and 
J such that 

tanh(/3J) = tanh(/3J)a;5(pi;^) , tanh(/3 J) = tanh(/3J)cZ'5(pfe,JcZ'5(p;^) (4) 

where Cba{pk^) is the infinite volume limit of the Boltzmann-Gibbs average 
of a random spin from an auxiliary system with a Viana-Bray one-body 
interaction Hamiltonian at connectivity a. This new system has spins 
denoted by pk , multi-overlaps denoted by , same couplings (independent 
copies) as the ones of the original system. Notice that given any trial multi- 
overlap there exists a such that the averaged multi-overlap take that value 
(see Appendix El- From our choice it is clear that a single a generates 
a whole sequence {g2n(ci)} of trial multi-overlaps. Our approach is based 
on the assumption that we can limit our trial functions to such sequences. 
Notice that the distribution of of J is completely determined by the one of 
J only, as no other quenched couplings arise. 
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Now we can use the identities 

oo ^ 

Incosh(-) = ^ ^ tanh2"(.) ,E ) = {q2n)a = Q2„(5) (5) 

n— 1 

to verify that the terms in J actnahy mutuahy cancel out and also to get 

^i-ElnZjvW = a V -^Etanh2"(/?J)((1 - q2nia)f - fen - q2n{a)?)t 
at N ^-^ 2n 

n>0 

where the i-dependent expectation has definite sign, hence we obtain the 
Rephca Symmetric bound and trial function from the fundamental theorem 
of calculus and Lemma ^ 

FRs{f3,a- {g2n(5)}) = ln2 + Elncosh(^^ J,(5)) 

1^=1 

oo 

T! = l 

which is the restriction of the usual Replica Symmetric trial function to 
the choice (0J and gives the correct annealed solution for a — 0, since 
92n(0) = and J(0) = 0. In other words, what we did is to conjecture 
that we can limit the trial function to those primary fields g with moments 
(of tanh(/3(7)) satisfying a certain constraint, namely the one given by the 
multi-overlaps. The reason relies on the Extended Variational Principle of 
ref. 2^ and the results of the next section. After all, on a physical basis 
we do not expect the occurrence of other probability distributions different 
from and totally independent of that of the original couplings. 

We want now to get the whole trial function in the value at zero of 
the "interpolating pressure" and we want to be left with a definite sign 
derivative yielding an immediate bound. This becomes essential in the 
Replica Symmetry Breaking. The interpolating Hamiltonian is 

t~i t~i cosh(/3J^) J 

-Efim^^^ + i.) (6) 

cosh(/3J,) J 
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and the generalized trial function is 



G^^lEln ^-^"P(-^^^"» ^fi(0) (7) 



where 



H{a)^H{0), H = H{l)-Hl^{a) , fl(t) = i-Eln (8) 

and Z(t) = Z(H{t)) is defined in the usual way. 
Now from Lemmas in Appendix ^ we get 

GN^GRsia) = ln2 + Elncosh(^^ J^,) 

+aElncosh(/?J) - 2aElncosh(/?J) + aElncosh(/3J) 

and 

llEln. - 



dt N exp{-(3H) 

a V -!-(tanh2"(/?J)q2 _ 2g2« tanh^"(/3J) + tanh^" (/3i))t 



2n 

n>0 



becomes 



-^^Eln ^/^^l = -aY^^Etanh'-mUq^n ~ q2n{a)f)t 
at iV exp(-/3i/) 'in 

with the usual choices for J and J. . 
Since 

Ieiu ^^^K =-PfV 

the fundamental theorem of calculus and the definite sign of the derivative 
above provide again the Replica Symmetric trial function and bound that 
we summarize in the just proved 

Theorem 4 With the choice defined by lO, and 10), H, and H satisfy 
© - ®, and 

-/?/(/?, a) < GRsia) = FRsia) V 5 G [0, ex.] . 
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Notice that, if /J'^ = aEtanh^(/3J) is fixed, then 
hm FXiiP,a,a)=Fi^{P') 

a — ^oo 

where F^g is the Replica Symmetric trial function for the Viana-Bray 
model constructed in this section, and F^g is the Replica Symmetric trial 
function for SK model. 

In the non-dilute case, a complete control of the high temperature 
regime can be gained by means of the quadratic replica coupling methodic, 
also when there is an external field. The extension of that method to the 
Viana-Bray model lead the same result, only when there is no external 
fieldE^. An external field reveals an intrinsic pathology of dilute models. 
But the presence of an external field seems to be pathological for the good- 
ness of the bounds also in the approach we propose in this article, we will 
comment on this later on. That is why wc limit ourselves to the case of zero 
external field, although mathematically it would be very easy to include it 
in the treatment. 



5 Replica Symmetry Breaking and Ultramet- 
ric RaMOSt 

In this section we will construct a trial free energy of Parisi type depending 
on ultrametric trial multi-overlaps. The purpose is to show that the itera- 
tive and the RaMOSt theories can be compatible, in the sense that there 
are trial functions that live both in a RaMOSt and in the probability space 
of the general trial function of the iterative method. Moreover, we want 
to show how one can construct a trial function depending on ultrametric 
multi-overlaps, extending the Parisi ultrametricity to the diluted case. Our 
main goal thus is not to find the exact value of the free energy, nor to get 
closer to it than one can get with the iterative trial function. In fact, we 
will construct a trial function that turns out to be some restriction of the 
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iterative trial function. Hence the trial function in this section cannot be 
closer to the true free energy than the iterative one. 

We need to generalize the ideas of the previous section, in particular the 
second identity in (|SJ) and the preceding discussion. Given any partition 
{x'^}a=o of interval [0, 1], there exists a sequence {aa}a=Q € [0, oo] such 
that q2n{cta) — Xa~ Xa-i- In other words, a sequence {(5a}^o G [0,oo] 
generates for each n e N a partition of [0, 1] considered as the set of trial 
values of q2m provided the oia are not too large 

92n(«a) < 1 • (9) 

a<K 

Again, we limit our trial multi-overlaps to belong to partitions generated 
in this way. This implies that the points of the generated partitions tend 
to get closer to zero as n increases. This is good, since in any probability 
space (<72n) decreases as n increases and therefore the probability integral 
distribution functions tend to grow faster near zero. 
We can then define W'-y, for 7 e N^, through 

W^(J, k^) = LOat{pk,,)J-tt H ^ ^&K{Pk,,)J-tf-yK 

with J — ±1 independent identically distributed symmetric random vari- 
ables. 

Definition 2 

g^i...^2„ = (g2„ - q2n)5^i...^i^ H h (g^ - 9^"^) (5^,1... ■ ■■6^1^...^^^ 

is the ultrametric 2n-overlap. 

Clearly this is just a kind of ultrametricity, imposed for each (even) number 
of replica individually. 
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The choice of Wj imposes an uhrametric structure since 




■■■5^1 



■ ■ - S^i 



(<72n - '?2n)'57|---7?" ^ ^ i^i ^ qL ^)^7? 



■7i-7f 



Ik- -Ik 



q2n — q.yi...j2' 



If we also define 



= W^{J,k^)W^{J',l^) 



where J' denotes independent copies of J, we have 



where the last expected equality can be easily verified by direct calculation. 
We clearly have in mind the case g^n = Oj 92ri = 1 (which implies the equal 
sign holds in 0). 

Now given a set of weights f ^ , 7 S , we can state the next 

Proposition 1 There exist H,H satisfying lO-® with q ultrametric. 

Before proving this proposition, let us consider the usual set of weights 
^^(toi, . . . , rrix), 7 = (71, ■ • ■ , Jk) associated to the Random Probability 
Cascade of Poisson-Dirichlet Processes through which one can express for- 
mulas of Parisi type (see e.g. ref. [Jj). Then take the trial function 



Notice that the trial function above is the usual difference between the 
"cavity" term and the "internal" term. Denoting by X the map 



N 



Eln^^^exp(-/5ifT,) Eln^ exp(-/37?^) . 




X : a. 



a 



m, 



a 
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satisfying @ we can consider the trial function as a function G{X) of X. 
We will prove the proposition above together with the next 

Theorem 5 The ultrametric trial function G{X) satisfies the bound 



as in Theorem ^ it enjoys the factorization property as in Theorem |31 (in 
the sense that H and H are independent, and each spin yields the same 
independent contribution) and it reduces to the Parisi trial function for the 
SK model in the infinite connectivity limit. 

Proof. Consider the interpolating Hamiltonian 



(3f{(3,a)<MG{X) 



H^{t) = H^^{t) + H^{1 -t)+ Hy{t) 



where 





and t is understood to multiply the connectivity a. Consider 



R{t) = -Eln 



, Gn = i?(0) 



This time let us chose Jj , of the form 



tanh(/3J^) = tanh(/3J)W^ , tanh(/3J^) = ta.nh{(3J)W. 



1 



and compute the usual t-derivative 
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where the fit is the generahzed Boltzmann-Gibbs average with the weights 
^. and the Hamihonian H{t). 
It is obvious that 

Ef}?"(W^^a,J = {q2nq2n)t , ^nf\W^) = {qjjt . 

This proves the proposition. 

The RaMOSt is thus equipped with aU the ingredients we need and we 
finaUy obtain 

jRit) = -a ^ i-E tanh^" (/? J) ((g2„ - q^n)^ (10) 

which is exactly the same expression as in equation (5) of ref. except 
here the trial multi-overlaps are not the Boltzmann ones, but rather some 
ultrametric ones, in the strictest analogy with the Parisi ROSt for SK. 
From H1(J|I we clearly get the ultrametric bound that we wanted to prove. 

Notice that G{X) does not depend on N, thanks to the same calcu- 
lations that led to Lemma in Appendix El Moreover W and W are 
chosen to be independent, therefore the factorization property of the opti- 
mal RaMOSt's illustrated in ref. P] holds: 

ElnQ^lci ■ ■ ■ cn exp(-/3iJ(a/7V))] =NB + aA 

for some B, and we used the notation ([2]) 

ci ■ • • Civ = ^ exp{~l3H) . 

Finally, a simple interpolation between the Parisi trial free energy (IB.14|I . 
at the if-th level of replica symmetry breaking, and G(X), at the same 
level of replica symmetry breaking, shows that in the infinite connectivity 
limit the two quantities coincide (modulo the proper temperature rescaling) 
since the infinite connectivity kills all the multi-overlaps but the 2-overlap, 
and the latter is the same ultrametric one in the two trial functions for each 
model. The trial values of the 2-overlap are the same in both trial functions. 
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If we choose the trial values for the SK model, then this determines the 
sequence of trial auxiliary connectivities to be used in the VB model. Vice 
versa, given a sequence of auxiliary connectivities, the dilute trial function 
reduces to the SK one with the same values of the trial 2-overlap. In more 
general and abstract terms, the constraints Ull-lO are such that a RaMOSt 
reduces to a ROSt with the same overlap kernel in the infinite connectivity 
hmit. □ 

What we did is, in other words, to "dilute" HB.12|) - (|B.13|I as 

E(tanh(/3 J^i ) • • • tanh(/3J^2„)) = Etanh^"(/3J)(7^i...^2„ , 
E(tanh(/3 J^i ) • • • tanh(/3J^2„)) = EtSinh^''{f3J)q^i,„^2,. . 

Notice that X together with Ua ^ 'i2n^ induces a map 

X2n{q) = ma , q2n^ < Q < Q^in ■ 

As a side remark, notice that the fundamental theorem of calculus ap- 
plied to implies that in any RaMOSt the part in If of Gat has the usual 
integral form like in the non-diluted case 



where X2n includes the integration in da (see Appendix ^ . In the par- 
ticular case of the Boltzmann RaMOSt, this is the "internal energy term" 
with the Boltzmann distribution of the multi-overlaps, since it has the in- 
tegral form above even without integrating back in da (see 0). In the 
Ultrametric RaMOSt, the corresponding distribution X2n is not the usual 
Parisi one that would yield 



while this is instead the case for the SK model. This means that the physics 
of the model and the interpretation of the parameters {rria} are still quite 





(11) 



a 
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obscure. In order to make the internal energy part have the same form as 
in the Boltzmann RaMOSt, one could consider for instance, among other 
possibilities, starting from leaving H out of the interpolation and then 
try to deduce the proper choice of H . 

Another remark. The trial function of the iterative method can be 
written using the same weights that we used here^^ . Then the cavity fields 
have generic distributions, which are the parameters to infimize over. The 
trial function we got could be obtained by imposing a restriction to such 
parameters in order to make the iterative trial function live in a RaMOSt 
(with ultrametric multi-overlaps). Hence in our example we make a very 
special choice both for the distribution of the cavity fields, and for the 
weights of the RaMOSt. This can easily mean simplifying too much. In 
fact, when there is an external field and the connectivity is smaller than one, 
the Replica Symmetric trial function of the iterative method is exact, while 
the Replica Symmetric trial function of the previous section is not (it is not 
too difficult to prove it through an expansion if powers of a. One could try 
and break the Replica Symmetry in order to get the exact value of the free 
energy, but it would be very unphysical and it would give non-selfaveraging 
overlaps and hence a strict inequality in Hl()|l V Despite its simplicity, the 
trial function of this section is enough to provide an example of trial func- 
tion with many good qualities. It is exact when there is no external field in 
the high temperature regime, it has the invariance property of the optimal 
structures, it exhibits ultrametricity, it depends on a few trial values of 
the auxiliary connectivity through which one can vary all the trial multi- 
overlaps simultaneously, it depends on a natural (decreasing) sequence of 
trial multi-overlaps as physically expected, it connects the iterative and the 
RaMOSt approaches, it does not need to introduce new generic probability 
distributions for the couplings, it is easier to compute than the iterative 
one, it gives the Parisi trial fmiction in the infinite connectivity limit, it 
belongs to a RaMOSt (and for the RaMOSt's the Extended Variational 
Principle has been proven, this is not the case in the iterative method). 
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6 Conclusions 



The ROSt approach is physicaUy very deep. One takes an auxiliary system 
with weights and a trial overlap, then a cavity field and an internal field, 
both Gaussian like the Hamiltonian. The two Gaussian variables stay the 
same, what changes is the space where they are defined. The trial overlap 
determines their covariance, which is the parameter to infimize over. A 
specific form of the trial function, like the Parisi one, is associated to a 
specific choice of the ROSt (space and weights). Letting the weights to be 
generic allows one to prove the extended variational principle. In dilute 
spin glasses we have the analogous structure (RaMOSt) with extended 
variational principle, and the iterative trial function, which is of the same 
form (with the same exponents) as the Parisi trial function for the SK 
model. Now, there are some natural steps to take. The iterative trial 
function must be somehow reduced to a multi-overlap structure (because 
of sectionOJ. The trial function must be constructed in a RaMOSt, and it is 
physically expected that the randomness of the cavity and internal fields be 
determined by the distribution of the original couplings (like for non-dilute 
spin glasses). It is interesting to find a minimal extension of the Parisi ROSt 
and to see whether it gives a good trial function. It is also interesting to 
see whether it is possible to construct a trial function with ultramctric trial 
multi-overlaps. Well, a trial function fulfilling all these requirements (with 
the proper invariance property) has been found, in the previous section, 
and it is not exact in some regions. We think such result is interesting, 
though of negative nature, and that the trial function is an instructive 
starting point for further developments. In any case, some considerations 
arise. The specific restriction of the iterative cavity fields we performed 
could be wrong, or else the weights of the RaMOSt might not be the right 
ones. The latter would be quite surprising (and also imply that iterative 
method is wrong too) . But if the restriction we exhibited is wrong, it means 
that either ultrametricity does not take place in diluted spin glasses, or at 
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least it must be implemented in a radically new way, as the dilution of 
the Parisi Ansatz is wrong. It is thus important to understand how the 
physics of dilute spin glasses is different from the non-dilute ones, and how 
to restrict the iterative trial function. 

A The Cavity Energy 

Let us compute the one-body interaction free energy. 
-E In exp(/3 Ju<Ji^ ) = In ^ exp(/3 J^Y. ^i. ) 

<T v=\ a i/=l i—1 

= In 2 + -E In JJ cosh(/J ^ J,6i,i^ ) 
1=1 1^=1 

P2C.N 

= In 2 E In cosh(/3 Y ^^^hi. ) ■ 

In the expression above, k (out of m) of the i^s will be equal to 1 with 
probability 

1\ k / TIT- \ TTh — k 
\ / N — 1 



k J \N J \ N 



and therefore 



If. In 7(1) 

N 



-E\nZ}^' = In 2+ 



EE 



m=0 fe=0 



1 .o.Am-fe.o..fe^r™ ^' 1 (^-1)' 



-2a(iv-i)g-2o^2a)'"-'=(2a)'=iV 



m\ ^ ^ k\{m-k)\N'' TV™-^ 

fc 

Elncosh(/3^ J^) 

!/=l 

Now the formula 

00 m / 00 \ / ^ \ 

Y E"'"-'^^'' = I E 1 1 E 1 

m=Ofe=0 \m=0 / \fe=0 / 

applies here and yields the following 
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Lemma 1 

^ P2ciV -P2C 

— E In ^ exp(/? J2 J'^'^^- ) = In 2 + E In cosh(/3 ^ J^) 

(7 V=\ V=l 

which contains two of the terms of the Rephca Symmetric trial functional. 
Remark: it is easy to see that 



pEln^exp(/3 ^ Xa^J = 2 ^ ^Etanh^" (/3J)(1 - (g2„)) 

!/=l n>0 



and since for any m = 0, 1, . . . 

d , , „ 

— TTalm) — > <^= a — > oo 
da 

where 'Ka{'m) is the Poisson measure of mean a, we deduce for all n 

{(l2n) ^1 <S= a ^ OO . 

B Parisi theory of SK 

Let us recall the well known SK Hamiltonian, which is defined as a centered 
Gaussian with covariance given by an overlap 

l,iV 



^ l,iV 



The cavity field Hi acting on the spin <Ji of the Parisi theory is given 
by the following decomposition of J 

-Hi = J^ = y^J7^ + • • • + ^/qK-qx-iJ^'"^'' ,i = l, N 

where the 7 indexes are the ones of the Random Probability Cascades of 
Poisson-Dirichlot processes, used for the weights ^-y(mi, . . . , ttlk) to express 
in a compact way the nested expectations of Parisi formula. The couplings 
of the cavity field are related to the original ones by the trial overlaps 

]E(J^ Jy) = E(j2)g.^y . (B.12) 
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Each trial overlap qa from the assumed partition of [0, 1] can be obtained 
as the overlap in an auxiliary system with a one-body interaction (for sim- 
plicity) with couplings J modulated by a suitable strength ^^x^, thanks to 
the monotone dependance of the overlap on x, i.e. (ja = q{xa)- But we can 
also put 



K 



qa ~ qa^i = q{xa) - q{xa^i) = = , " ^ 

a=l 

and re-write the cavity field as 

-H, = ^/W^)JT +■■■ + ^q{xK)Jr""' ■ 

The ultrametricity is intrinsic in the Hi's, as can be easily checked by their 
covariance, which is the only quantity that is related to both the overlap 
and the generalized bound (see ref. [3). The internal energy is therefore 
expressed introducing (see ref. 0) 



-H=J^= J71 + . . . + ^^^^ „ q2^_^Jf 

or equivalently 

E(J^Jy) =E(J2)92^, , (B.13) 
and the trial function can be written as 

GP = lKln?-il!f£t^^£iM . -Pf^_,,s{X) (B.14) 
N E,C.exp(-/3i/) ^ ^ ^ 

where X is the Parisi order parameter. Notice that there is a = y{x°') 
such that 

and that {y^^} is determined by {x^} since 

a 

fa ~ fa-l = - qa-l){qa + Qa-l) = q^"^) (2 ^ q(x'-) + q{x^+^)) 

r=l 

SO that the trial function G can be expressed in terms of the only. 
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Moreover, it is easy to see that 

lEln^e.exp(-/37?) = ^ J^X iq)dq ^ ^^{1 - {q')) 

using for instance integration by parts or Fubini theorem. The second 
equaUty above holds in full generality, for any average (•) in some space 
of a random variable q between zero and one, the distribution of which 
can be denoted by X. In particular, X can be the one associated to the 
Boltzmann-Gibbs measure or the Parisi one: in the former case H is given 
in ref. [J, the latter case has just been illustrated. 
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